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We introduce a finite-time detailed fluctuation theorem of the form P{AScnv) ~ e^^""^ P{—AScnv) 
for an appropriately weighted probability density of the external entropy production in the envi- 
ronment. The fluctuation theorem is valid for nonequilibrium systems with constant rates starting 
with an arbitrary initial probability distribution. We discuss the implication of this new relation 
for the case of a temperature quench in classical equilibrium systems. The fluctuation theorem is 
tested numerically for a Markov jump process with six states and for a surface growth model. 
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I. INTRODUCTION 

In nonequilibrium statistical physics one of the most 
important advances in recent years has been the discov- 
ery of various fluctuation relations [TVH6). which con- 
strain the probability distribution of entropy fluctua- 
tions. These relations are of great theoretical impor- 
tance, being the most general statements for nonequi- 
librium systems and constituting a generahzation of the 
second law of thermodynamics. Moreover, some of these 
relations can be tested in real experiments, as for exam- 
ple the Jarzynski relation [5j , which relates the work done 
on a process driven out of equilibrium with equilibrium 
free energy differences. 

A so-called detailed fluctuation theorem (DFT) is a 
symmetry of the probability distribution P{AS) of some 
time-integrated quantity AS* along the stochastic trajec- 
tory of the system. As pointed out by Seifert in a recent 
review [Tl|, there are two types of DFTs. The flrst one, 
here denoted as strong DFT, is a symmetry of the form 



P{AS) = e'^^Pi-AS) 



(1) 



which relates the positive half with the negative half of 
the distribution. The other type, called weak or Crooks- 
type DFT, is a relation of the form 



PiAS) 



.AS 



P\-AS) 



(2) 



between two different probability distributions P and P^ , 
where the latter corresponds to some kind of conjugate 
or reversed process. 

DFTs imply identities for averages of certain functions 
of AS*, which are known as integral fluctuation theorems 
(IFTs). It turns out that the two variants differ signif- 
icantly in their predictive power: A weak DFT implies 
only a single IFT, namely 



-AS\ 



/ + 00 
dAS- P{AS) e-^^ = 1 , 
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(3) 
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Using Jensen's inequality for convex functions this IFT 
induces in turn the second law inequality 



(AS*) > 0. 



(4) 



Contrarily, a strong DFT implies infinitely many IFTs of 
the form 

/ + 00 
dAS P{AS) ^ 0, 

-OO 

(5) 

where A(AS) — ^A{—AS) is an arbitrary antisymmetric 
function. Choosing A{AS) — sinh(AS'/2) one can see 
that these IFTs include Eq. ([s]), and therewith the second 
law Q, as a special case. 

In this paper we obtain a new strong DFT for Markov 
jump processes. So far the only quantity which is known 
to obey a strong DFT is the total entropy production 
of the system combined with its environment, provided 
that the transition rates are constant and that the system 
is stationary throughout the whole observation period. 
Here we obtain a finite-time strong DFT for constant 
transition rates, which is valid for relaxation processes, 
i.e. the initial probability distribution does not need to 
be the stationary one. Moreover, the quantity entering 
our DFT is the entropy that flows from the system to the 
environment A5'env 

As a concrete application, we consider a temperature 
quench of an equilibrium system in contact with single 
heat bath. We show that the probability distribution of 
the energy that flows from the reservoir to the system 
during the relaxation process is constrained by a simple 
IFT. We also conflrm this IFT numerically in a micro- 
scopic model for surface growth. Furthermore, we verify 
the proposed DFT numerically in the case of an explicit 
nonequilibrium system with six configurations and ran- 
domly chosen rates. 

The paper is organized as follows: In the next section 
we present the DFT for the entropy production. As an 
application we discuss the case of a temperature quench 



in a equilibrium system in section III while section IV 
contains the numerical tests. The paper ends with con- 
cluding remarks in section |V] A proof of the DFT can be 
found in the appendix. 
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II. FLUCTUATION THEOREM FOR THE 
ENTROPY PRODUCTION A5e„v 

Let us consider a stochastic Markov process with arbi- 
trary constant rates Wc-^c' and an arbitrary initial distri- 
bution pi' . Drawing an initial configuration cq from this 
distribution, the process evolves along a certain stochas- 
tic path 7, reaching some final configuration ct at time T. 
If F[y] is a functional of the path, its average over many 
realizations is given by 



(6) 



where the integral runs over all possible stochastic 
paths 7 and W[j] denotes the statistical weight of the 
path. Here we are particularly interested in the entropy 
production in the external environment AS'envH) which 
is defined as 



(7) 



happen 



where the path 7 is such that jumps Cj 
at times tj, n is the total number of jumps along the 
path, and Cj is the configuration of the system in the 
time interval [tj,tj^i\. The corresponding probability 
distribution can be expressed as 



P(A5e„v = X) = {5{X- A5e„v[7]); (8) 
V^W[-i] 5(X-A5e„v[7])- 



I' 



In order to establish a fluctuation theorem for A^envi we 
introduce a weighted average 



(9) 



with the additional boundary weights Xco.ct ''^''^'^ '"^ "Cor- 
responding normalization factor f\f = j 'D^W['y\xco,CT■ 
lx\ the following we shall assume that the boundary 
weights Xco,CT are constrained by the symmetry 

Xco.ctPIo = XcT,coPcl ^cq,Ct- (10) 
The corresponding weighted probability density reads 

P(A5env = X) = (5{X - A^envM))^ (H) 

= V^WU Xco,c. 5{X - A5[7]e„v) • 



For example, if we choose Xco, ct — Pct^ this gives the 
probability of A5env in an ensemble where each stochas- 
tic trajectory is weighted with the initial probability dis- 
tribution of the final state. 



As our main result, we find that this weighted proba- 
bility density of the external entropy obeys a strong DFT 
of the form 

P(A5e„v = X) = e^P(A5env = -X). (12) 

A proof of this relation is given in the appendix. This 
strong DFT impUes the IFT 



e-^^-/M(A5e„v)\ =0 



(13) 



for arbitrary antisymmetric functions A{x), including the 
special case 



-ASe, 



1 



AS,, 



> 0. 



(14) 



Let us again emphasize that these fluctuation relations 
are valid for any time T and that the initial probability 
distribution can be chosen freely. This means that they 
can be used to study the relaxation into a (equilibrium 
or nonequilibrium) steady state. 

In order to carry out the averages weighted by Xco,ct ) it 
is necessary to know the initial and final configurations 
of each stochastic trajectory. This information is eas- 
ily accessible in numerical simulations. In experiments, 
however, the initial and final configurations are usually 
not known explicitly. This means that the fluctuation 
theorem can only be applied if we define the weights in 
such a way that they can be computed from another ex- 
perimentally measurable quantity. As an example, we 
will consider the relaxation of a system with equilibrium 
dynamics in the following section. 

We note that it would be possible to absorb the weights 
Xco,ct into the exponential, so that the results above can 
be written as ordinary (unweighted) averages. However, 
we think that in general there is not much benefit from 
such a notation, since as a consequence of this we no 
longer have a DFT for A^env 



HI. ENERGY FLUCTUATIONS AFTER A 
TEMPERATURE QUENCH 

Let us now restrict to classical equilibrium systems, 
where each configuration c € is associated with a cer- 
tain internal energy Ec- Suppose that the system is ini- 
tially in thermal equilibrium, in contact with a single 
heat bath of constant temperature Ti, as described by a 
stationary Boltzmann-Gibbs distribution 



1 



(15) 



where Pi = 1/Ti and Z{Pi) = Ec^"'^'^" denotes the 
partition sum. 

Then, at time t = 0, let us suddenly increase or de- 
crease the temperature of the heat bath to a different 



constant value p2 = V^a- After the quench the system 
is expected to relax into a new stationary equilibrium 
state. Let us select a certain instance of time T > be- 
fore this equilibrium is reached and ask the question how 
the total energy that flows from the reservoir into the 
system A£' = Ec^. — Ec„ during the relaxation process is 
distributed. 

To answer this question, we first note that the tem- 
perature quench does not change the energy functional 
Ec, rather it causes a discontinuous change of the transi- 
tion rates Wc-i-c'- Before the quench (for t < 0) the rates 
are constant and obey detailed balance. At t — the 
rates assume a different set of constant values, obeying 
detailed balance with the new temperature T2, i.e. 



Wr 



(16) 



This means that the entropy that flows from the system 
to the heat bath in the jump c — >■ c' is given by 



A5f 



= In- 



= -132AE, 



(17) 



Knowing that the rates are constant after the quench, 
this tells us that the entropy production along a stochas- 
tic path 7 is related to the system energy change by 



-p2AE[^]=-p2{Ecr~E,^ 



(18) 



which holds exactly even if the system has not yet reached 
the new equilibrium state. 

To describe the energy fluctuations in this situation, 
we now define the weights as 



Xc 



(0 /J^) 

Co : 



(19) 



which obviously fulfills the symmetry condition (10 1. 
With this choice and the given initial state before the 
quench (15 1, these weights can be expressed as 



_ -/31AB/2 



(20) 



Inserting this expression into Eq. ( 13 ) we obtain 



= (e-^^-/M(A5_) 



(21) 



where we used Eq. ^ in the last equality. Inserting the 
weights (201 and absorbing the prefactors — /32 and Af 



into A{x) = A{-P2x)/N, we obtain the IFT 



e2 



i(Ai?)) =0, 



(22) 



where A/3 = P2 ~ Pi and A is an arbitrary antisymmet- 
ric function. In this expression the brackets (. . .) denote 




Deposition at rate q 



Evaporation at rate 1 



FIG. 1. (Color online) Growth process on a substrate. Parti- 
cles are deposited and removed at rate q and 1, respectively, 
provided that the resulting configuration does not violate the 
constraint \hi — hi±i\ < 1. The green arrows indicate exam- 
ples of positions where deposition and evaporation is allowed. 



the ordinary (non-weighted) average over many trajecto- 
With the special choice A{x) = sinh(iA/3x), this 



ries. 



expression reduces further to 



(23) 



Note that the corresponding 'second law' (A/SAE) < 
simply means that the average energy increases (de- 
creases) if the system is heated up (cooled down) dur- 
ing the temperature quench. We note that a fluctuation 
relation similar to ( 23 ) has been obtained in [T7j . 



IV. NUMERICAL TESTS 

A. Height fluctuations in a growth process 

To demonstrate the findings of the preceding section, 
we first consider a solid-on solid growth process on top 
of an inert substrate, which was investigated some time 
ago in the context of wetting phenomena [HI [19] . The 
model is defined on a d-dimensional square lattice with 
periodic boundary conditions, where each site i is asso- 
ciated with the height hi — 0,1,2,... of an interface. It 
evolves random-sequentially by randomly depositing and 
removing particles with certain rates. These dynamical 
rules are constrained by the restriction that neighboring 
height must not differ by more than one unit, introducing 
an effective surface tension. 

For simplicity we consider here the case of a one- 
dimensional ring with N sites (see Fig. [I]) with random 
deposition at rate qi and evaporation at rate 1, subject 
to the constraint 



h 



< 1 



{h 



N+1 



hi) 



(24) 



For qi < 1 the system is known to be in a bound state 
with a stationary probability distribution 



Pi{h,}) (X = e 



(25) 



where H = is the total number of deposited par- 

ticles and fi = —Inq is the chemical potential. Obviously 
this is an equilibrium state, where fj, and H play the role 
of the inverse temperature and the internal energy, re- 
spectively. 
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FIG. 2. (Color online) Convergence of (e'^"'^-^) to 1 in the 
growth model with a small system size. Each run starts with 
an empty lattice and evolves for 50 time steps to equilibrate. 
After the quench the process is simulated over 3 further time 
steps to reach the final state. Black and red lines denote 
system sizes A'^ = 2, 4 respectively; solid lines stand for a 
quench gi — 0.5 q2 ~ 0.8, dotted ones for qi — 0.2 — >■ 52 = 
0.9. 



In this stationary state, let us suddenly change the 
growth rate to a new constant value q2 < I at t — 0. 
Subsequently the system relaxes into a new equilibrium 
state. Applying the results of the preceding section, the 
fluctuations of the total number of deposited atoms AH 
between t = and t = T obey the IFT 



1 



(26) 



where A/i = —(In 52 — In 91). In Fig.[2]we show how this 
average converges to 1 as the number of runs increases, 
confirming this IFT in the example of the growth model. 



B. Nonequilibrium process with a small state space 

The previous examples are special in so far as the initial 
and the asymptotic final state for t ^ 00 obey detailed 
balance. To demonstrate that our DFT works for any 
nonequilibrium system with constant rates, we simulated 
a Markov jump process with 6 configurations and 6^—6 = 
30 which are randomly chosen between and 1. Likewise, 
the initial probability distribution is randomly initialized. 
Initially the master equation is iterated numerically in 
order to determine Pc{T), as shown in the upper panel 
of Fig. [3j Then we perform a large number of Monte- 
Carlo runs, starting with an initial configuration drawn 
randomly from pc and adding up the contributions to 
the entropy production whenever the system jumps to a 
different configuration. 

At time T — 2 the accumulated entropy production 
is discretized and registered in two histograms. One 
of them is created as usual by counting the outcomes. 
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FIG. 3. (Color online) Simulation of a nonequilibrium pro- 
cess with six configurations, (a) Starting at t = with a 
randomly chosen initial distribution pi'-' and randomly cho- 
sen constant rates Wc^^./ the probability distribution Pc{t) 
evolves according to the master equation and relaxes into 
a new nonequilibrium steady state, as shown in the upper 
panel, (b) Histogram of P(AS'env = X) (black bars) to- 
gether with e^P(ASonv = -X) (red dots) taken at T = 2, 
demonstrating that the unweighted probability density does 
not obey a DFT. (c) Contrarily, th e we ighted probability den- 
sity P{AScnv ~ X) defined in Eq. 1 11 1 does obey a finite-time 



DFT, as indicated by the matching of the black bars and the 
red dots. 



As 



whereas the other one is weighted with Xco,ct — P^t 
can be seen in Fig. IsJ), the data for P(A5env = X) and 
e^P(A5cnv — —Xj differ from each other, confirming 
that the unweighted probability density does not obey 
a DFT. However, plotting the same data in a weighted 
histogram, we observe a perfect coincidence in agreement 
with the DFT ^ (see Fig.lsfc). 



V. CONCLUSIONS 

In this paper we have introduced a strong DFT for 
the entropy production AS'env which is valid for constant 
rates. In contrast to the usual strong DFT for the to- 
tal entropy A5'tot, which requires the initial state to be 
stationary, the initial probability distribution can be ar- 
bitrary in our case. This means that our DFT is par- 
ticularly suitable for the study of relaxation processes 
from arbitrary initial conditions into equilibrium as well 
as nonequilibrium steady states. 

As shown in the appendix, the proof of this DFT fol- 
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lows the same lines as the proofs of other known fluctua- 
tion relations. Our strong DFT is particular in so far as 
it uses an ensemble of trajectories weighted by an extra 
boundary term Xcq.ct^ see equation 

As an application, we have shown that our results im- 
ply an IFT for the energy fluctuations during the re- 
laxation of a system in contact with a single heat bath 
after a sudden temperature quench. In this example the 
boundary terms Xco,ct become proportional to the expo- 
nential of the energy difference. It would be interesting 
to find examples of relaxation to a nonequilibrium sta- 
tionary state where these boundary terms also acquire a 
clear physical interpretation. Moreover, an experimental 
verification of relation (23) should be possible. 



It is worth noting that the IFT (23) for the growth 
process discussed in section |IV A| seems to hold even if 
the model quenched from the bound (gi < 1) to the mov- 
ing phase ((72 > !)• We therefore hope that our results 
may be useful to describe properties of phase transitions, 
although at this point this remains speculative. 
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Appendix A: Proof of the fluctuation theorem 



Here we present a proof of Eq. ( 12 ) following the proof 
of the master FT in [T5] (see also |zO|). Let us consider 
a specific stochastic path 7 of n spontaneous transitions 
taking place at times U £ [0, T] and the corresponding 
reversed path 7^: 



In the same way, for the reversed path we have P[7^] 
PcmQIi^ and 



-tiAf 



n 

[n 



-{tj + i-tj)Aj 



(A3) 



Therefore, the ratio of the conditional probabilities is re- 
lated to the external entropy production by 



n 



Wc 



„ASe„v[7] 



Wr-tr- , 



(A4) 



Let us now consider an arbitrary functional Flj] which 
is antisymmetric under path reversal, i.e. 



F[7t] = -F[j]. 



(A5) 



Moreover, let g{x) be an arbitrary function applied to this 
functional. Using ( Al ), its weighted average according to 
Eq. ([9| is defined by 

(5(^^17]))^ = T^IP^} Q[l] Xco.c. 9{F[l]). (A6) 

Summing over all reversed paths, the above formula be- 
comes 



(A7) 



Using ( A4 ) and ( A5 ) , we obtain 



Finally, using the symmetry assumed in (10), i.e 



(A8) 



t\ t-2 

7 : Co — > ci — > C2 — ) 



7 



T-t„ T-t„_i 



Co . 



Let the conditional probability Q['y\ be the probability of 
the path 7 given that the initial state is Cq, i.e. 



we have 
.9(^^17]) 



(A9) 



^ , 2?7pi^-^^--'^lQ[7]Xco,c.5(-^^[7]), 



(Al) which can be rewritten as 



(AlO) 



Defining the escape rates Aj = "^^i Wc^^c' , this condi- 
tional probability distribution is written as 



n 

Q[7]= [11' 



Wc 



-(T-t„)A„ 



(A2) 



(All) 



The fluctuation relations presented in this paper can 
all be derived from this relation. For example, setting 

F[7] = AS-envb] and <?(AS'cnv[7]) = S{X - AS^nAl]) one 
obtains the strong DFT (Il2|. 
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